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Abstract 

Parameterized runtime analysis seeks to understand the influence of problem structure on 
algorithmic runtime. In this paper, we contribute to the theoretical understanding of evolu- 
tionary algorithms and carry out a parameterized analysis of evolutionary algorithms for the 
Euclidean traveling salesperson problem (Euclidean TSP). 

We investigate the structural properties in TSP instances that influence the optimization 
process of evolutionary algorithms and use this information to bound the runtime of simple 
evolutionary algorithms. Our analysis studies the runtime in dependence of the number of inner 
points k and shows that (// + A) evolutionary algorithms solve the Euclidean TSP in expected 
time 0((/i/A) ■ n 3 -f(e) + nj(e) + (/i/A) • n ik (2k — 1)!) where 7 is a function of the minimum angle 
e between any three points. 

Finally, our analysis provides insights into designing a mutation operator that improves the 
upper bound on expected runtime. We show that a mixed mutation strategy that incorporates 
both 2-opt moves and permutation jumps results in an upper bound of 0(([i/\)-n 3 "f(e) + nj(e) + 
(/x/A) • n 2k (k - 1)!) for the (/x + A) EA. 

1 Introduction 

In many real applications, the inputs of an NP-hard combinatorial optimization problem may 
be structured or restricted in such a way that it becomes tractable to solve in practice despite 
having a worst-case exponential time bound. Parameterized analysis seeks to address this by 
expressing algorithmic runtime in terms of an additional hardness parameter that isolates the 
source of exponential complexity in the problem structure. In this paper, we study the application of 
evolutionary algorithms (EAs) to the Euclidean Traveling Salesperson Problem (TSP) and consider 
the runtime of such algorithms as a function of both problem size and a further parameter that 
influences how hard the problem is to solve by an EA. 

1.1 The Euclidean traveling salesperson problem 

Iterative heuristic methods (such as local search and evolutionary algorithms) that rely on the 
exchange of a few edges such as the well-known 2-opt (or 2-change) operator are popular choices 
for solving large scale TSP instances in practice. This is partly due to the fact that they have 
a simple implementation and typically perform well empirically. However, for these algorithms, 
theoretical understanding still remains limited. Worst-case analyses demonstrate the existence of 
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instances on which the procedure can be inefficient. Chandra, Karloff, and Tovey [3], building from 
unpublished results due to Lueker, have shown that local search algorithms employing a fc-change 
neighborhood operator can take exponential time to find a locally optimal solution. Even in the 
Euclidean case, Englert, Roglin, and Vocking [11] have recently shown that a local search algorithm 
employing inversions can take worst-case exponential time to find tours which are locally optimum. 

If the search operator is restricted to specialized 2-opt moves that remove only edges that 
intersect in the plane, van Leeuwen and Schoone [30] proved that a tour that has no such planar 
intersections can be reached in 0(n 3 ) moves, even if a move introduces further intersecting edges. 
Since determining which edges are intersecting can take quadratic time, a locally optimal tour can 
be found in time 0(n 5 ). We point out that a local optimum in this restricted neighborhood does 
not necessarily correspond to a local optimum in the general 2-opt neighborhood. 

If the vertices are distributed uniformly at random in the unit square, Chandra, Karloff, 
and Tovey [3] showed that the expected time to find a locally optimal solution is bounded by 
0(n 10 log n). More generally, for so-called ^-perturbed Euclidean instances, Englert, Roglin, and 
Vocking [TT] proved that the expected time to find a locally optimum solution is bounded by 
0(n 4+1 / 3 log (n</>)(^> 8//3 ). These results also imply similar bounds for simple ant colony optimization 
algorithms as shown in |16j . 

To allow for a deeper insight into the relationship between problem instance structure and 
algorithmic runtime, we appeal in this paper to the theory of parameterized complexity [7j. Rather 
than expressing the runtime solely as a function of problem size, parameterized analysis decomposes 
the runtime into further parameters that are related to the structure of instances. The idea is to find 
parameters that partition off the combinatorial explosion that leads to exponential runtimes [8]. 

In the context of TSP, a number of parameterized results currently exist. Deineko et al. [5] 
showed that, if a Euclidean TSP instance with n vertices has k vertices interior to the convex 
hull, there is a dynamic programming algorithm that can solve the instance in time bounded by 
g(k) ■ where g is a function that depends only on k. This means that this parameterization 

belongs to the complexity class FPT, the class of parameterized problems that are considered fixed- 
parameter tractable. Of course, membership in FPT depends strongly on the parameterization 
itself. For example, the problem of searching the /c-change neighborhood for metric TSP is hard 
for W[l] due to Marx [19] . Therefore, the latter parameterization is not likely to belong to FPT. 

1.2 Computational complexity of evolutionary algorithms 

Initial studies on the computational complexity of evolutionary algorithms consider their runtime on 
classes of artificial pseudo-Boolean functions p~0l EH [HJ [32] . The goal of these studies is to consider 
the impact of the different modules of an evolutionary algorithm and to develop new methods 
for their analysis. This early work was instrumental in establishing a rigorous understanding 
of the behavior of evolutionary algorithms on simple functions, for identifying some classes of 
problems that simple EAs can provably solve in expected polynomial time [10] , and for disproving 
widely accepted conjectures (e.g., that evolutionary algorithms are always efficient on unimodal 
functions [9]). 

More recently, classical polynomial-time problems from combinatorial optimization such as min- 
imum spanning trees [22\ [20] and shortest paths \25\ [2] have been considered. In this case, one 
does not hope to beat the best problem-specific algorithms for classical polynomial solvable prob- 
lems. Instead, these studies provide interesting insights into the search behavior of these algorithms 
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and show that many classical problems are solved by general-purpose algorithms such as evolution- 
ary algorithms in expected polynomial time. 

Research on NP-hard combinatorial optimization problems such as makespan scheduling, cov- 
ering problems, and multi-objective minimum spanning trees |2 1 1. [3~T] show that evolutionary algo- 
rithms can achieve good approximations for these problems in expected polynomial time. In the 
case of the TSP, Theile [29] has proved that a (// + 1) EA based on dynamic programming can 
exactly solve the TSP in at most 0(n 3 2 n ) steps when fj, is allowed to be exponential in n. For 
a comprehensive presentation of the different results that have been achieved see, e.g., the recent 
text of Neumann and Witt [23] . 

Algorithmic runtime on NP-hard problems can be studied in much sharper detail from the 
perspective of parameterized analysis, and this has only recently been started in theoretical work 
on evolutionary algorithms. Parameterized results have been obtained for the vertex cover prob- 
lem [18], the problem of computing a spanning tree with a maximal number of leaves [17J, variants 
of maximum 2-satisfiability [26] , and makespan scheduling [28] . 

1.3 Our results 

In this paper, we carry out a parameterized complexity analysis for evolutionary algorithms for 
the Euclidean TSP. We prove upper bounds on the expected runtime of two classical EAs based 
on 2-opt mutation in the context of the TSP parameterization of Deineko et al. [5], that is, as a 
function of the number of points that lie on the interior of the convex hull. Our results are for the 
(fj, + A) EA which operates on a population of fi permutations (candidate Hamiltonian cycles) and 
produces A offspring in each generation using a mutation operator based on 2-opt. This analysis 
provides further insights into the optimization process that allows us to design a mixed mutation 
operator that uses both 2-opt moves and permutation jumps and improves the upper bound on 
expected runtime of the (n + A) EA. 

By setting \i = A = 1 and changing the mutation operator to single random 2-opt moves, we also 
prove parameterized runtime bounds for randomized local search (RLS): a randomized hill-climber 
on the space of permutations. In this case, we present results for the expected time for RLS to 
converge to a locally optimal tour in terms of 2-opt moves. Specialized results for RLS and the 
(1 + 1) EA using 2-opt mutation appear in a conference version of this paper presented at AAAI 
2012 [27] . 

The paper is organized as follows. In Section [2] we introduce the problem, algorithm and 
analysis. In Section [3] we study structural properties of the Euclidean TSP. In Section d] we study 
the runtime of the (// + A) EA and RLS on Euclidean TSP instances whose points lie in convex 
position, i.e., have no inner points. In Section [5] we then prove rigorous runtime bounds for the 
algorithms as a function of the number of inner points in an instance. We conclude the paper in 
Section [6] 

2 Preliminaries 

Let V be a set of n points in the plane labeled as [n] = {l,...,n} such that no three points 
are collinear. We consider the complete, weighted Euclidean graph G = (V, E) where E is the 
set of all 2-sets from V. The weight of an edge {u, v} G E is equal to d(u,v): the Euclidean 
distance separating the points. The goal is to find a set of n edges of minimum weight that form a 
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Figure 1: Intersecting edges form the diagonals of a convex quadrilateral. 



Hamiltonian cycle in G. A candidate solution of the TSP is a permutation x of V which we consider 
as a sequence of distinct elements x = (xi,a?2, ... ,x n ), such that Xi £ [n]. The Hamiltonian cycle 
in G induced by such a permutation is the set of n edges 



The optimization problem is to find a permutation x which minimizes the fitness function 



Geometrically, it will often be convenient to consider an edge {u, v} as the unique planar line 
segment with end points u and v. We say a pair of edges {u,v} and {s,t} intersect if they cross 
at a point in the Euclidean plane. An important observation, which we state here without proof, 
is that any pair of intersecting edges form the diagonals of a convex quadrilateral in the plane (see 
Figured]). 

Proposition 1. If {u,v} and {s,t} intersect at a point p, they form the diagonals of a convex 
quadrilateral described by points u, s, v, and t. Hence edges {s,u}, {s,v}, {t,v} and {t, u} form a 
set of edges that mutually do not intersect. 

Definition 1. A tourC(x) is called intersection-free if it contains no pairs of edges that intersect. 
2.1 Parameterized analysis 

Parameterized complexity theory is an extension to traditional computational complexity theory 
in which the analysis of hard algorithmic problems is decomposed into parameters of the problem 
input. This approach illuminates the relationship between hardness and different aspects of problem 
structure because it often isolates the source of exponential complexity in NP-hard problems. 



C{x) = {{XI,X 2 }, {x 2 , X 3 }, ... , {x n -l,X n }, {x n ,Xl}} . 





{u,v}£C(x) 
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A parameterization of a problem is a mapping of problem instances into the set of natural 
numbers. We are interested in expressing algorithmic complexity in terms of both problem size and 
the extra parameter. Formally, let L be a language over a finite alphabet S. A parameterization 
of L is a mapping k : X* — > IN. The corresponding parameterized problem is the pair (L, k). 

For a string x E £*, let = k(x) and n = |x|. An algorithm deciding x € L in time bounded 
by • n°« is called a fixed-parameter tractable (or fpt-) algorithm for the parameterization 
Here g : IN — > IN is an arbitrary but computable function. Similarly, an algorithm that decides a 
parameterized problem (L, k) in time bounded by n 9 ^ is called an XP-algorithm. 

When working with the runtime of randomized algorithms such as evolutionary algorithms, one 
is often interested in the random variable T which somehow measures the number of steps the 
algorithm must take to decide a parameterized problem. A randomized algorithm with expected 
optimization time E(T) < g(k) ■ (respectively, E(T) < n 9 ^) is a randomized fpt-algorithm 

(respectively, XP-algorithm) for the corresponding parameterization n. 

In the case of the Euclidean TSP on a set of points V, we want to express the runtime complexity 
as a function of n and k where n = \V\ and k is the number of vertices that lie in the interior of 
the convex hull of V. We will hereafter refer to these points as the inner points of V. For the 
corresponding optimization problem, we are interested in the runtime until the optimal solution is 
located. 



2.2 Simple evolutionary algorithms 

Randomized search heuristics such as randomized local search and evolutionary algorithms that are 
tasked to solve TSP instances are usually designed to iteratively search the space of permutations 
in order to minimize the fitness function defined in Equation ([I]). Each permutation corresponds 
to a particular Hamiltonian cycle in the graph. To move through the space of candidate solutions, 
move or mutation operators are often constructed based on some kind of elementary operations on 
the set of permutations on [n]. In this paper, we will consider two such operations: inversions and 
jumps which we define as follows. 

Definition 2. The inversion operation a]j transforms permutations into one another by segment 
reversal. A permutation x is transformed into a permutation o~}j [x] by inverting the subsequence in 
x from position i to position j where 1 < i < j < n. 

X — (xi , . . . , Xi—l , X{ , Xj_|_l , • • • , Xj _l , Xj , Xj+l , . . . , Xn) 
®ij ["^] — ' ' ' ' » 1 ; *Vj j "Ej— x, • • • , Xj-|_i , Xi , Xjjf.\ , . . . , Xj-j) 

In the space of Hamiltonian cycles, the permutation inversion operation is essentially identical 
to the well-known 2-change (or 2-opt) operation for TSP. The usual effect of the inversion operation 
is to delete the two edges {xj_i,Xj} and {xj,Xj + i} from C(x) and reconnect the tour C(cr^[x]) 
using edges {xj_i,Xj} and {xj,Xj + i} (see FigureEJ. Here and subsequently, we consider arithmetic 
on the indices to be modulo n, i.e., 1 — 1 = n and n + 1 = 1. Since the underlying graph G is 
undirected, when (i, j) = (l,n), the operation has no effect since the current tour is only reversed. 
There is also no effect when £ {(2,n), (l,n — 1)}. In this case, it is straightforward to check 
that the edges removed from C(x) are equal to the edges replaced to create C(<r^[x]). 

Definition 3. The jump operation ajj transforms permutations into one another by position shifts. 
A permutation x is transformed into a permutation af- [x] by moving the element in position i into 
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Figure 2: The effect of the inversion operation on a Hamiltonian cycle. 

position j while the other elements between position i and position j are shifted in the appropriate 
direction. Without loss of generality, suppose i <j. Then, 

Xi , , • • • , Xj , Xj+i , . . . , Xn) 

•Ei—li -Ei+l j • • • ) •Ej—lj Xi, Xj , Xj+i , . . . , X n ) 
Xi—Xt Xj , Xi , , . . . , Xj — i , Xj-\-\ , . . . , X n ) 

Since o~^ i+1 ^ and have the same effect, there are n[n — 1) — (n — 1) = (n — l) 2 unique 

jump operations. The jump operator was used by Scharnow, Tinnefeld and Wegener [25] in the 
context of runtime analysis of evolutionary algorithms on permutation sorting problems. 

In this paper, we consider simple mutation-only evolutionary algorithms that operate on per- 
mutations as follows. 

1. Initialization: Generate a set of /i permutations on [n] uniformly at random. 

2. Mutation: Generate a set of A "offspring" permutations by applying some type of randomized 

move or mutation operator based on the above operations. 

3. Selection: Select the fittest [i permutations out of the both parent and offspring population 

and continue at line 2. 

The general form of such a mutation-only evolutionary algorithm is typically called a (//+ A) EA. 
Algorithm [T] illustrates the (fx + A) EA. Note that here, the select function selects the \i best 
(with respect to fitness) permutations from the parent population P and the offspring population 
P'. This selection mechanism ensures that best-so- far individual found by generation t remains in 
the population at generation t, i.e., the (/x + A) EA exhibits elitism. 

To generate offspring using the previously introduced inversion operation, the (/i + A) RA 
employs a mutation operator that applies a number of random 2-opt moves that is drawn from a 
Poisson distribution. This mutation operator, called 2-opt -mutation, is outlined in Function [2j 

If we restrict the mutation operation to a single inversion move and set fj, = A = 1, the 
resulting algorithm is randomized local search (RLS), which is simply a randomized hill-climber in 



x = (xi, . . . , 
°ij[x) = (xi,--., 
vjM = (xi,..., 
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Algorithm 1: The (n + A) EA. 



1 Choose a multiset P of /j, random permutations on [n]; 

2 repeat forever 
P> <- {}; 
repeat A times 

choose x uniformly at random from P; 
y <— mutate(x); 
P'^P'y{y}; 

P *- select(P tiJ P') ; 



Function 2: 2-opt -mutation (x) 
input : A permutation x 
output: A permutation y 

1 y <- x; 

2 draw s from a Poisson distribution with parameter 1; 

3 perform s + 1 random inversion operations on y; 

4 return y; 



the space of permutations using 2-opt moves. RLS, illustrated Algorithm [3l operates by iteratively 
applying random inversion operations to a permutation in order to try and improve the fitness 
of the corresponding tours. Unlike the (// + A) EA, RLS can only generate immediate inversion 
neighbors so it can become trapped in local optima. 



Algorithm 3: Randomized Local Search (RLS). 

1 Choose a random permutation x on [n\\ 

2 repeat forever 

3 choose a random distinct pair of elements from [n]; 

4 y^ajjix]; 

5 if f(y) < f(x) then x <- y 



2.3 Runtime analysis 

Evolutionary algorithms are simply computational methods that rely on random decisions so we 
consider them here as special cases of randomized algorithms. To analyze the running time of such 
an algorithm, we examine the sequence of best-so-far solutions it discovers during execution 

( T (i) T (2) r (t) \ 

as an infinite stochastic process where x^' denotes the best permutation (in terms of fitness) in the 
population at iteration t. The goal of runtime analysis is to study the random variable that equals 
the first time t when x^) is a candidate solution of interest (for example, an optimal solution). 
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The optimization time of a randomized algorithm is a random variable 

T = inf{t G IN : is optimal}. (2) 

In the case of the (/u + A) EA, this corresponds to the number of generations (iterations of the 
mutation, evaluation, selection process) that occur before an optimal solution has been introduced 
to the population. This is somewhat distinct the traditional measure of the number of explicit calls 
to the fitness function |23|, [Tj . However, in the case of the (fj, + A) EA, this metric can be obtained 
from T by Tf = [i + AT, since we need \x fitness function calls to evaluate the initial population 
and each generation requires evaluating an additional A individuals. We discuss this further in 
section [5j 

In this paper, we will estimate the expected optimization time of the (/i + A) EA. This quantity 
is calculated as E(T), the expectation of T. Since RLS can become trapped in local optima, its 
expected optimization time is not necessarily finite. In this case, we introduce the random variable 

Tioc = inf{i G IN : has no improving 2-opt neighbors}. (3) 

and estimate the expected time RLS takes to reach a locally optimal solution. 

Definition 4. Let a be an indicator function defined on permutations of [n] as 



a(x) 



1 ifC{x) contains intersections; 
otherwise. 



a{x) if f(x) non-optimal 
otherwise. 



Definition 5. Let f3 be an indicator function defined on permutations of [n] as 

P(x) = | 

The random variable corresponding to optimization time can be expressed as the infinite series 

oo 

r = X>0r<'>) + (4) 

t=l 

In order to characterize the behavior of evolutionary algorithms and express their expected 
runtime in terms of the number of points n and the number of inner points k, we analyze the 
Markov chain generated by the algorithm. We construct the Markov chain as follows. Given a 
point set V, Each permutation x on [n] that corresponds to a tour C(x) that is non-optimal is a 
unique state in the Markov chain. Finally, every permutation that corresponds to an optimal tour 
in V is associated with a single absorbing state opt. We then bipartition the state space (minus 
opt) into two sets S a and Sp where 

S a = {x : C(x) contains intersecting edges}, 

and 

Sp = {x : C(x) is intersection-free } \ {opt}, 

In terms of the Markov chain, the optimization time T is the first hitting time of the state opt. We 
will need the following two preparatory lemmas, the first of which is analogous to the additive drift 
result due to He and Yao [13] . 
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Figure 3: Partitioned Markov chain with transition probability bounds. Note that x' can be in 
either S a or Sp. 

Lemma 1. // there are constants < p < 1 and c > such that for any x £ S a , the transition 
probability from x to some x' with f(x') < f(x) — c is bounded below by p, then 

E a ( xW )^ ^ V~ X n(d max - d m i n ) /C, 

where d max and d m i n are the maximum and minimum distances between any two points in V , 
respectively. 

Proof. By hypothesis, since p > for any x £ S a there is a nonzero probability the algorithm exits 
the state x and never returns since the sequence of best-so-far solutions increases monotonically in 
fitness. Therefore, the expectation in the claim exists and is finite. 

Consider the finite stochastic process (y^\y^ 2 \ . . . ,y^), which is defined as the restriction of 
(x^\ x( 2 \ . . .) constructed by taking only permutations G S a in the same order. It follows that 



E(m). 



Let y^ be the first state in the restricted stochastic process. Since every state has a transition to 
a state that improves the fitness by at least c with transition probability at least p, the expected 
number of states with f(y^) > f(y®) > f(y^) — c is bounded by p -1 . Continuing this 
argument, the expected waiting time until the fitness of any state y® is improved by at least c is 
at most p~ x . 

For any arbitrary permutation x, nd max > f(x) > nd m i n so there can be at most n(d max — 
dmin) /c such improvements possible. □ 
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Lemma 2. If there is a constant < q < 1 such that for any x E Sp, the transition probability 
from x to opt is bounded below by q, then 

e (x>(* w )J ^ 

Proof. Again, since q > for any x 6 Sp there is a nonzero probability the algorithm exits the 
state x and transits to the absorbing state opt. It follows that the expected time spent in states 
contained in the Sp partition is bounded above by q . □ 

In the next section, we will carefully analyze properties of the Euclidean TSP to find suitable 
values for p, q, and c. This will allow us to bound the expected runtime in terms of n and k. 



3 Structural properties 

We now examine some useful structural properties of Euclidean TSP instances related to the inver- 
sion operator. We also introduce some structural constraints that will later facilitate the param- 
eterized analysis. We begin by pointing out that if a tour is not intersection-free, an intersection 
can always be removed by an inversion. This notion is captured by the following lemma. 

Lemma 3. Let x be a permutation such that C(x) is not intersection- free. Then there exists an 
inversion that removes a pair of intersecting edges and replaces them with a pair of non-intersecting 
edges. 

Proof. Suppose {xi-x,Xi} and {xj,Xj+i} intersect in C(x). Let y = o\j[x\. Then 

C{x) \ C{y) = {{xi-i,Xi},{xj,Xj + i}} , and 
C{y) \ C{x) = {{xi- 1 ,x j },{x i ,x j+1 }} . 

By Proposition [Q since and {xj,Xj + \} intersect, the two new edges introduced to C(y) 

by o~lj do not intersect. Note that it is still possible that the introduced edges intersect with some 
of the remaining edges in C(y). □ 

We denote by $)(V) Q V the convex hull of V. A permutation x respects hull-order if any 
two points in the subsequence of x induced by $)(V) are consecutive in x if and only if they are 
consecutive on the hull. 

Lemma 4. IfC(x) is intersection- free, then x respects hull-order. 

Proof. This follows immediately from the proof of Theorem 2 in [21] . □ 

Lemma H] entails the following bound on the cardinality of Sp, the set of permutations that 
correspond to intersection- free tours. 

Lemma 5. Suppose \V \ Sj(V) \ = k. Then \Sp\ < (n — k) k k\. 

Proof. For any set of 1 < p < n points, there are p n ~ p (n — p)\ permutations in which the p points 
remain in the same order. Since |ij(V) | = (n — k), there are exactly (n — k) k k\ permutations that 
respect hull-order. Since each intersection-free tour must respect hull-order, we have the claimed 
bound. □ 
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We also can derive from Lemma H] the following convenient bound on the minimal number of 
operations necessary to transform an intersection-free tour into a permutation that corresponds to 
a globally optimal tour. 

Lemma 6. Suppose \ V \ Sj(V) \ = k and C(x) is an intersection- free tour on V . Then there is a 
sequence of at most k jump operations that transforms x into an optimal permutation. 

Proof. By LemmaHl since C{x) is intersection-free, it must be hull-respecting. Let x* be an optimal 
permutation such that the elements in $)(V) have the same linear order in x* as they do in x. Then 
x can be transformed into x* by moving each of the k inner points into their correct position. □ 

Lemma 7. Suppose \V \ S)(V) \ = k and C(x) is an intersection- free tour on V . Then there is a 
sequence of at most 2k inversions that transforms x into an optimal permutation. 

Proof. By Lemma [6l k jump operations are enough to transform x into an optimal permutation. 
The claim then immediately follows from the fact that any jump operation can be simulated by at 
most two consecutive inversion operations. In particular, 



ojjlx] if \i -j\ = 1; 

^• (i _i)[^jW] if * — j < 1; 



°h+uMM if * - j > i. 



Since a sequence of at most k jump operations can be simulated by a sequence of at most 2k 
inversion operations, the claim is proved. □ 

A challenge to the the runtime analysis of algorithms that employ edge exchange operations 
such as 2-opt is that, when points are allowed in arbitrary positions, the minimum change in 
fitness between neighboring solutions can be made arbitrarily small. Indeed, proof techniques for 
worst-case analysis often leverage this fact [11] . To circumvent this, we impose bounds on the 
angles between points, which allows us to express runtime results as a function of trigonometric 
expressions involving these bounds. Momentarily, we will refine this further by introducing a class of 
TSP instances embedded in an m x m grid. In that case, we will see that the resulting trigonometric 
expression is bounded by a polynomial in m. 

We say V is angle-bounded by e > if for any three points u, v,w £ V, 0<e<9<ir — e where 
9 denotes the angle formed by the line from u to v and the line from v to w. This allows us to 
express a bound in terms of e on the change in fitness from a move that removes an inversion. 

Lemma 8. Suppose V is angle-bounded by e. Let x be a permutation such that C{x) is not 
intersection-free. Let y = a\- [x] be the permutation constructed from an inversion on x that replaces 
two intersecting edges in C(x) with two non-intersecting edges^ Then, if d m i n denotes the minimum 
distance between any two points in V , f(x) — f(y) > 2d m i n 

Proof. The inversion ajj removes intersecting edges {u, v} and {s,t} from C(x) and replaces them 
with the pair {s, u} and {t, v} to form C(y). We label the point at which the original edges intersect 
as p. 



1 Lemma|3] guarantees the existence of such an inversion. 
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Denote as 9 U and 9 V the angles between the line segments that join at each point u and v, 
respectively. Since all angles are strictly positive, the points u, s, and p form a nondegenerate 
triangle with angles 9 S , 6 U , and (tt — {0 S + 9 U )). By the law of sines we have 

d(s,u) d(s,u) d(u,p) d(s,p) 



sin (tt - (9 S + 9 U )) sin (9 S + 9 U ) sm(O s ) sin(6>„) 

Hence, 

a( \ i At \ a< ^ f sm(9 s ) + sm(9 u )\ 

d(u,p) + d(s,p) = d(s,u)[ . . (5) 

V sm(6 s + e u ) ) 

Since u, s, and p form a triangle, < (9 S + 0«) < vr and we have 

< sin(0 s ) < 1 since < 9 S < tt, 

< sm(9 u ) < 1 since < 9 U < tt, 

< sin (9 S + 9 U ) < 1 since < 9 S + 6>„ < tt. 

Furthermore, since V is angle-bounded by < e < tt — e, by ©, 

dfop) + d( S ,p) > n) f Sm(e) + ^ m(e) ) >d(s,u). (6) 

\ sm(e + e) J 

Since there is also a nondegenerate triangle formed by the points t, v, and p, a symmetric argument 
holds and thus 

,/ n ,/ n ,/ n / sin(e) + sin(e) \ . 

d(t,p) + d(v,p) > d(t, v) \ ' y > d(t, v). (7) 

V sm(e + e) / 

Combining Equations © and ([7]) we have 

f{x) - f(y) = [d(u, v) + d(s, t)] - [d(t, v) + d(s, u)] 
= d(u, p) + d(v, p) + d(t, p) + d(s, p) - [d(t, v) + d(s, u)] 

> [d(t, v) + d(s, u)} ( ) - [d(t, v) + d(s, u)] > 

V sm(2e) ) 

The constraint that the difference is strictly positive follows directly from Equations ([6]) and ([7|). 
Hence, 

fix) - f(y) > [d(t, v) + d(s, u)} ( " 

\ sm(2e) / \ cos(e) / 

The lower bound on the angle between any three points in V provides a constraint on how small 
the change in fitness between neighboring inversions can be. This lower bound is useful in the case 
of a quantized point-set. That is, when the points can be embedded on an m x m grid as illustrated 
in Figured! 

Quantization, for example, occurs when the x and y coordinates of each point in the set are 
rounded to the nearest value in a set of m equidistant values (e.g., integers). We point out that it is 
still important that the quantization preserves the constraint on collinearity since collinear points 
violate a nonzero angle bound. We have the following lemma. 
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Figure 4: Quantizing a set of n points in the plane onto an m x m grid. 



Lemma 9. Suppose V is a set of points that lie on an m x m unit grid, no three collinear. Then 

V is angle-bounded by arctan (l/(2(m — 2) 2 )). 

Proof. The grid imposes a coordinate system on V in which the concept of line slope is well-defined. 
Let u,v,w S F be arbitrary points. We consider the angle 9 at point v formed by the lines from 
v to u and v to w. Let s\ and s 2 denote the slope of these lines, respectively. If the slopes are of 
opposite sign, then 9 > 2 arctan((m — l) -1 ) since the lines form hypotenuses of two right triangles 
with adjacent sides of length at most m — 1 and opposite sides with length at least 1 (see Figure [5]). 

We now consider the case where the slopes are nonnegative. The nonpositive case is han- 
dled identically (or by simply changing the sign of the slopes by the appropriate transforma- 
tion). Without loss of generality, assume s\ > S2 > 0. Equality is impossible since u, v, 
and w cannot be collinear. Since the points lie on an m x m grid, s\ and s 2 must be ra- 
tios of whole numbers at most m—1, say s\ = a/b and S2 = cjd. The angle at point v is 
9 = arctan(a/6) — arctan(c/(f) = arctan ^ td+ac ) ■ ^ ne mm i m um positive value for the expression 
(ad — cb) I (bd + ac) over the integers from to m — 1 is 2 (m~2) i • ^ mce * ne inverse of the tangent is 
monotone, the minimum nonzero angle must be 9 > arctan (l/(2(m — 2) 2 )). □ 

Lemma [9] allows us to translate the somewhat awkward trigonometric expression in the claim 
of Lemma [8] (and subsequent lemmas that depend on it) into a convenient polynomial that can be 
expressed in terms of m. 

Lemma 10. Let V be a set of n points that lie on an m x m unit grid, no three collinear. Then, 

V is angle-bounded by e where cos(e)/(l — cos(e)) = 0(m ). 



Proof. It follows from Lemma [9] that the angle bound on V is e = arctan (l/(2(m — 2) 2 )). S 
cos (arctan (x)) = l/v 7 ! + x 2 we have 



nice 



cos(e) 



2(m - 2f 



l-cos(e) v / l + 4(m-2) 4 -2(m-2) 2 
and since z/(y/l + z 2 — z) = 0(z 2 ) , setting z = 2(m — 2) 2 completes the proof. 



□ 



We are now ready to prove the following technical lemma for 2-opt mutation defined in Func- 
tion [2) This lemma will be instrumental in proving runtime bounds later in the paper. 
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Figure 5: If the slope of the lines from v to u and v to w are of opposite sign, they form the 
hypotenuses of two right triangles and 9 > 2arctan((m — 

Lemma 11. Let V be a set of planar points in convex position angle-bounded by e. We have the 
following. 

(1) For any x S S a , the probability that 2- opt mutation creates an offspring y with f(y) < 
f{x) — 2d m i n (1 — cos(e)) / (cos(e)) is at least 2/(en(n — 1)). 

(2) For any x G Sp, the probability that 2- opt mutation creates an optimal solution is at least 
[en ik {2k - l)!)" 1 

Proof. For (1), suppose x G S a . By Lemma [3l there is at least one pair of intersecting edges in 
C(x) that can be removed with a single inversion operation cr| ■ . Let y = o~]j[x]. By Lemma El f(y) 
satisfies the fitness bound in the claim. It suffices to bound the probability that y is produced by 
2-opt-mutation(x) . 

Let Ei denote the event that Poisson mutation performs exactly one inversion (i.e., s = in 
line [2] of Function [2J). Let E 2 denote the event that the pair (i,j) is specifically chosen for the 
inversion. 

We have Pr{£i} = e _1 from the Poisson density function and Prj^l-E-i} > {n(n — 1)/2) _1 . 
Thus the probability that 2-opt mutation creates y from x is 

Pr{£i U E 2 } = Pr{£i} • Pi{E 2 \E l } > 2/(en(n - 1)). 

For (2), suppose x £ Sr. Thus, C(x) is intersection-free, and it follows from Lemma [7] that 
there are at most 2k inversion moves that transform x into an optimal solution. 

Let E[ denote the event that Poisson mutation performs exactly 2k inversions (i.e., s = 2k — 1 
in line [2j of Function [2]) . Let E' 2 denote the event that all 2k inversions are the correct moves that 
transform x into an optimal solution. 

Again, from the Poisson density function, Pr{£^} = (e(2k — l)!) -1 Since Pr-f-E^I-^} ^ (n(n — 
l)/2)~ 2k > n _4fc , the probability of transforming x into an optimal solution is at least 

Pt{E[ n E' 2 } = Pt{E[} ■ Pv{E' 2 \E[} > (en 4k (2k - l)!) -1 . 

□ 

Finally, since the time bounds in the remainder of this paper are expressed as a function of the 
angle bound e, and the bounds on point distance, it will be useful to define the following function. 
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Definition 6. Let V be a set of points angle-bounded by e. We define 

,s _ ( dmax _±\ f cos ( e ) A 
\dmin / \1" COs(e)7 

where d max and d m i n respectively denote the maximum and minimum Euclidean distance between 
points in V . 

4 Instances in convex position 

A finite point set V is in convex position when every point in V is a vertex of its convex hull. 
Deineko et al. [5] observed that the Euclidean TSP is easy to solve when V is in convex position. In 
this case, the optimal permutation is any linear ordering of the points which respects the ordering 
of the points around the convex hull. Such an ordering can be found in time 0(n log n) [I]. 

In the context of evolutionary algorithms, the natural question arises, if V is in convex position, 
how easy is it for simple randomized search heuristics? In this case, a tour is intersection-free if 
and only if it is globally optimal, hence finding an optimal solution is exactly as hard as finding an 
intersection-free tour. Since an intersection can be (at least temporarily) removed from a tour by 
an inversion operation (c.f. Lemma[3|), we focus in this section on algorithms that use the inversion 
operation. 



4.1 RLS 

RLS operates on a single candidate solution by performing a single inversion in each iteration. Since 
each inversion which removes an intersection results in a permutation whose fitness is improved by 
the amount bounded in Lemma it is now straightforward to bound the time it takes for RLS to 
discover a permutation that corresponds to an intersection- free tour. 

Theorem 1. Let V be a set of planar points in convex position angle-bounded by e. The expected 
time for RLS to solve the TSP on V is 0(n 3 7(e)) where 7 is defined in Definition^ 

Proof. Consider the infinite stochastic process generated by Algorithm [3] . . .). It suffices 

to bound the expectation of the random variable T defined in Equation (J2]). Since V is in convex 
position, any intersection-free tour is globally optimal. Thus, in this case Sp = 0, and Equation 
@ can be written as 

00 

T = J2 a i x(t) )- 

t=l 

Consider an arbitrary permutation x € S a . Since C{x) must contain intersections, by Lemma [3j 
there is an inversion <rj- which removes a pair of intersecting edges and replaces them with a pair 
of non-intersecting edges. Moreover, by Lemma El such an inversion results in an improvement of 
at least 

2d min (1 - cos(e)) / (cos(e)) . (8) 

If the state x is visited by RLS, the probability that this particular inversion is selected uniformly 
at random is 2/(n(n — 1)). Thus we have the conditions of Lemma[T]with p = 2/(n(n — 1)) and c 
equal to the expression in ([8]) and the claimed bound on the expectation of T follows. □ 
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Corollary (to Theorem [Tj). If V is in convex position and embedded in an m x m grid with no 
three points collinear, then RLS solves the TSP on V in expected time 0(n 3 m 5 ). 

Proof. The bound follows immediately from Theorem [1] since V is in convex position and since, 
by Lemma [H V is angle-bounded by arctan (l/(2(m — 2) 2 )) , d max = (m — l)\/2, and d m i n = 1. 
Appealing to Lemma [TOl yields cos(e)/(l — cos(e)) = 0(m 4 ). Substituting these terms into bound 
of Theorem [1] completes the proof. □ 



4.2 The (fj, + A) EA 

We now consider the optimization time of the (// + A) EA using 2-opt mutation defined in Algo- 
rithm Q] applied to a set of points in convex position. Obviously, in this case we will find \i and A 
terms appearing in the runtime formulas. We will assume that [i and A are polynomials in both n 
and k. We will also find that setting A = 0(/jn 2 ) ensures that a transition from any state £S a a 
state which improves on the fitness by at least a specified amount occurs with constant probability. 

Such a setting has the effect of reducing the number of generations spent removing intersections 
from the best-so-far tours. However, it is important to note that the number of calls to the fitness 
function must be accordingly increased by a factor of 0(/_m 2 ) in each generation. Nevertheless, the 
expected number of generations can be a useful measure when considering parallel evolutionary 
algorithms. As Jansen, De Jong and Wegener [15] have pointed out, when the fitness evaluation 
of the offspring can be performed on parallel processors, the number of generations corresponds to 
the parallel optimization time. In such a case, we would observe a quadratic factor improvement 
in the parallel runtime corresponding to the segment spend in tours with intersections. 

The following theorem bounds the number of expected generations the (fj, + A) EA needs to 
solve the Euclidean TSP on a set of angle-bounded points in convex position. 

Theorem 2. Let V be a set of planar points in convex position angle-bounded by e. The ex- 
pected time for the (// + A) EA using 2-opt mutation to solve the TSP on V is bounded above by 
0((fj,/X) • n 3 7(e) + 717(e)) where 7 is as defined in Definition® 

Proof. The sequence of best-so- far permutations generated by Algorithm [1] is the infinite stochastic 
process (x^\x^\ . . .) and we seek the expectation of the random variable T defined in Equation (j2J). 
Again, in the case of convex position, there are no non-optimal intersection-free tours so that Sp = 
and 

00 

T = £«(*«). 
t=i 

As long as x^ is non-optimal, C(x^) must contain at least one pair of intersecting edges. Hence, 
in generation t, if x^ is selected for mutation to create one of the A offspring, then by Lemma \TT\ 
2-opt mutation must improve the best-so-far solution by at least c = 2d m i n (1 — cos(e)) / (cos(e)) 
with probability at least (en(n — 1)/2) _1 . The probability that at least one of the A offspring 
improves on by at least this amount is 



\ien{n — 1) /2 
We now make the following case distinction on A. 
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Case A > fien(n — l)/2. For this setting of A, we have p > 1 — e _1 , so an intersection is removed 
in each generation with constant probability. Invoking Lemma [TJ the expected time to find 
an intersection-free tour is at most 0(n'y(e)). 

Case A < fien(n — l)/2. Here we have 



The final inequality comes from the fact that e~ x < 1 — x/2 for < x < 1. Thus, in this case 
we have p > A/(/ien 2 ). Applying Lemma [H the expected time to find an intersection-free 
tour is at most 0((fi/X) ■ n 3/ y(e)). 

Thus the expected time to solve the instance is bounded by 0(max{(///A) • n 3 ^(e),n^/(e)}) which 



Analogous to the Corollary to Theorem [H we have the following. 

Corollary (to Theorem [2]). If V is in convex position and embedded in an m x m grid with no 
three points collinear, then RLS solves the TSP on V in expected time 0((///A) • n 3 m 5 + nm 5 ). 

5 Parameterized runtime analysis 

We now turn our attention to TSP instances in which Sj(V) ^ V and express the expected runtime 
in terms of n = |V|, the number of points, and k =\V \ $)(V) |, the number of inner points. 

5.1 Expected time to find 2-opt local optima 

When $)(V) ^ V, RLS does not necessarily converge to the global optimum with probability one 
since it can become trapped in a local optimum. However, if the number of inner points is sparse 
(i.e., O(l)), we can bound the complexity of finding local optima. In other words, we want to 
estimate E(Ti oc ), defined in Equation ([3]). 

For RLS, a permutation x is locally optimum in the 2-opt neighborhood if there does not exist 
an inversion y = [x] such that f(y) < f(x). In this case, RLS cannot make further improvements. 
Indeed, if no three points are collinear in V, then if x is locally optimal, C(x) must be intersection- 
free since, if it were not, Lemma [3] guarantees an inversion exists that removes an intersection and, 
by the quadrangle inequality, the resulting offspring would have improving fitness. It is important 
to note that the converse is not necessarily true. However, we may show the following. 

Lemma 12. Suppose C(x) is intersection-free. Then for any neighboring inversion y = o-\j[x] with 
f(y) < f(x), C(y) is also intersection-free. 

Proof. Suppose for contradiction that y = o-jJx] with f(y) < f(x), but C(y) is not intersection-free. 
Since C(x) was intersection- free, it follows that the pair of edges introduced by the inversion must 
intersect. By the quadrangle inequality, the total length of these edges must be greater than the 
edges they replaced, contradicting that f(y) is strictly less than f(x). □ 




fxen{n — 1) 



A 



yields the claimed bound. 



□ 
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Theorem 3. Suppose V is angle bounded by e and that \ V\Sj{V) \ = k. Then the expected time until 
RLS finds a local optimum in the 2-opt neighborhood is 0(n 3 7(e) + n 2k kl) where 7 is as defined in 
Definition [6j 

Proof. After RLS finds an intersection- free tour, by Lemma [T2l all subsequent tours will also be 
intersection free. The total number of intersection-free tours hence serves as a bound on the number 
of possible improving moves after the first intersection-free tour is encountered. By Lemma this 
bound is (n — k) k k\. 

As long as RLS has not yet found a local optimum, by definition there exists an improving 
inversion; the expected waiting time to find such an inversion is bounded by 0{n 2 ). Thus, after 
the first time an intersection- free tour is encountered, the expected time until a local optimum is 
found is bounded by 0(n 2k k\). 

Finally, for any £ S a , by Lemma [8] there is a pair such that 

/(4^)])</(xW)-2d min f^^y 

J \ cos(e) / 

The probability that RLS selects this inversion is 2/(n(n — 1)). Substituting these values into 
Lemma [T] completes the proof. □ 

If the points in V are quantized in an m x m grid, we can appeal directly to Lemmas [9l and [TU1 
to substitute the corresponding angle bounds into the bound obtained in Theorem [3J This results 
in the following corollary. 

Corollary (to Theorem[3]). Suppose that V is quantized in an mxm grid and that \V\Sj(V) \ = k. 
Then the expected time until RLS finds a local optimum is 0(n 3 m 5 ) + 0(ra 2fc /c!). 

5.2 The + A) EA using 2-opt mutation 

The (// + A) EA does not suffer from convergence to local optima as does RLS since it uses a Poisson 
mutation strategy and thus has a non-zero probability of generating any tour (this follows from the 
connectedness of the inversion adjacency, see, e.g., [L?]). 

We now use the structural analysis in Section [3] to show that when there are few inner points, 
intersection-free tours are somehow "close" to an optimal solution in the sense that relatively small 
perturbations by the EA suffice to solve the problem. Again, recall that we assume [i and A are 
polynomials in both n and k. 

Theorem 4. Let V be a set of points angle-bounded by e such that \V \ Sj(V) \ = k. The ex- 
pected time for the (fi + A) EA using 2-opt mutation to solve the TSP on V is bounded above by 
O ((/i/A) • n 3 7 (e) + 717(e) + (p/X) ■ n ik {2k - 1)!) . 

Proof. We argue by analyzing the Markov chain generated by the (/i + A) EA using 2-opt mutation. 
Let (a^ 1 ), x^ 2 \ . . .) denote the sequence of best-so-far states visited by the (/i + A) EA. 

In generation t, if G S a , then the probability of generating an offspring that improves the 
fitness by at least c = 2d m i n (1 — cos(e)) / (cos(e)) is identical to that in the proof of Theorem [2j 
Arguing in the same manner as in the proof of Theorem [21 we have 

00 

]>>(*W) = 0(( M /A) • n 3 7 (e)) + n 7 (e)). 
t=\ 
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On the other hand, if x^' G Sp, if it is selected for mutation, then, by Lemma PTTl 2-opt mutation 
produces the optimal solution with probability at least (en 4:k (2k — 1)!) —1 . Hence, the overall prob- 
ability of generating an optimal permutation when is the (intersection-free) population-best 
permutation is at least 



A 




lien ik {2k - l)\ J ~ 2 / uen 4fc (2/c - 1)! ' 

Since this is the probability that the Markov chain transits from a state G <Sg to the optimal 
state, substituting the value for q into the claim of Lemma O we have 

0((n/\) ■n 4k (2k- 1)!). 

The bound on E(T) then follows from Equation [3] and linearity of expectation. □ 
Again, from Lemmas [9] and [10] we have the following corollary. 

Corollary (to Theorem E]). Let V be a set of points quantized on an m x m grid such that \V \ 
Sj(V) | = k. The expected time for the (/i + A) EA using 2-opt mutation to solve the TSP on V is 
0((jj,/X) ■ n 3 m 5 + nm 5 + (p/X) ■ n 4k (2k - 1)!). 



5.3 Mixed mutation strategies 

Our analysis so far has revealed important insights into the problem structure of the Euclidean 
TSP with k inner points and the inversion operator. We now take advantage of these insights to 
design a new evolutionary algorithm with the aim of explicitly reducing the bound on the expected 
number of iterations until a permutation corresponding to an optimal TSP tour is found. 

The Markov chain analysis relies on the inversion operator to construct an intersection-free 
tour, but then relies on the inversion operator to simulate the jump operator in order to transform 
an intersection-free tour into an optimal solution. We now introduce a mutation technique called 
mixed-mutation (outlined in Function U]) that performs both inversion and jump operations, each 
with constant probability. This allows for a bound which is faster by a factor of 0(n 2k (2k — l)\/(k — 

i)0- 

Similar to Lemma PTTI we have the following result for mixed mutation. 
Lemma 13. Let V be a set of planar points in convex position angle-bounded by e. Then, 

(1) For any x G S a , the probability that mixed mutation creates an offspring y with f(y) < 
f{x) — 2d m i n (1 — cos(e)) / (cos(e)) is at least (en(n — 1)) _1 . 

(2) For any x G Sp, the probability that mixed mutation creates an optimal solution is at least 
(2en 2k (k-l)\y 1 

Proof. For (1), the probability that mixed mutation selects inversions is 1/2 and the rest of the 
claim follows from the argument of Lemma [TTT 

For (2), suppose x G Sp. Thus, C{x) is intersection- free, and it follows from Lemma [6] that 
there are at most k jump operations that transform x into an optimal solution and the remainder 
of the proof is identical to that of Lemma PTT1 The probability that mixed mutation selects jump 
operations contributes the leading factor of 2 _1 . □ 
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Function 4: mixed-mutation (x) 
input : A permutation x 
output: A permutation y 

1 y <- x) 

2 draw r from a uniform distribution on the interval [0, 1]; 

3 draw s from a Poisson distribution with parameter 1; 

4 if r < 1/2 then 

5 |^ perform s + 1 random inversion operations on y; 

6 else 

7 |^ perform s + 1 random jump operations on y; 

8 return y; 



Theorem 5. Let V be a set of points angle-bounded by e such that \V \ Sj(V) \ = k. The ex- 
pected time for the (/i + A) EA using mixed mutation to solve the TSP on V is bounded above by 
0((/x/A) • n 3 ~f(e) + 717(e) + (fi/X) • n 2k {k - 1)!) . 

Proof. The proof is identical to the proof of Theorem [H except we substitute the probabilities from 
Lemma [T51 into Lemmas [JJ and □ 

As before, from Lemmas l9l and [TOl we have the following. 

Corollary (to Theorem [5]). Let V be a set of points quantized on an m x m grid such that \V \ 
Sj(V) | = k. The expected time for the (fj, + A) EA using mixed mutation to solve the TSP on V is 
0((/VA) • n 3 m 5 + nm 5 + (/i/A) • n 2k (k - 1)!). 

6 Conclusion 

In this paper, we have studied the runtime complexity of evolutionary algorithms on the Euclidean 
TSP. We have carried out a parameterized analysis that studies the dependence of the hardness of 
a problem instance on the number of inner points in the instance. Moreover, we have shown that 
under reasonable geometric constraints (low angle bounds), simple evolutionary algorithms solve 
the convex TSP in polynomial time. 

In the case that an instance contains k inner points, we have shown that randomized local 
search using 2-opt can find local optima in expected 0(n 3 7(e)) + 0(n 2k k\) iterations where 7 is 
a function of the angle bound e. For example, when the instance is embedded in an m x m grid, 
7(e) = 0(m 5 ). 

Similarly, for the (//+A) EA, we have bounded the expected number of generations to solve a TSP 
instance with k inner points as 0((///A)-n 3 7(e)+n7(e) + (^/A)-n 4fc (2/c — 1)!). Using the analysis, we 
have also introduced a mixed mutation strategy based on both permutation jumps and 2-opt moves 
which attains an improved expected runtime bound of 0((/x/A) -n 3 7(e) + 71.7(e) + (/-i/A) -n 2k (k — 1)!). 
Hence, with this paper, we have shown that the (// + A) EA is a randomized XP-algorithm for the 
inner point parameterization of Demeko et al. [5j. It remains an open question whether or not the 
algorithm is also a randomized fpt-algorithm. 
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